Skip to content

chore(helm): bump inference-operator to v3.8 (chart 2.8.3) - #482

Merged
papriwal merged 1 commit into
aws:mainfrom
oyangz:feature/update-inference-operator-v3.8
Nov 19, 2026
Merged

papriwal merged 1 commit into
aws:mainfrom
oyangz:feature/update-inference-operator-v3.8

Conversation

@oyangz

@oyangz oyangz commented Nov 18, 2026 •

Copy link
Copy Markdown
Contributor

What's changing and why?

Summary

Update the inference-operator chart to operator v3.8 (chart 2.7.0 -> 2.8.3). Also bumps the parent chart's dependency reference to 2.8.3.

Changes

  • Versions: chart version 2.8.3, appVersion "3.8", image.tag v3.8. Subcharts: aws-mountpoint-s3-csi-driver 1.14.1 -> 1.15.0, aws-fsx-csi-driver 1.17.0 -> 1.19.0 (Chart.lock regenerated).
  • CRDs (backward compatible):
    • IEC: new spec.dynamoSpec (managed NVIDIA Dynamo).
    • IEC and JumpStartModel: new spec.inferenceGateway.globalRouting.enabled, an opt-in field that publishes the model's inference gateway to the Global Inference Gateway for cross-Region routing.
    • IEC and JumpStartModel: new status.selfHealCount.
    • Stricter validation on invocationEndpoint and loadBalancer.healthCheckPath (path-safe pattern, max 256). Existing objects that violate it keep running; updates to them are rejected until fixed.
  • Manager: memory limit 256Mi -> 512Mi.
  • RBAC: operator can manage nvidia.com dynamographdeployments.
  • values.yaml: pin newer EKS Distro sidecars for the Mountpoint S3 CSI driver (node-driver-registrar v2.13.0-eks-1-33-9, livenessprobe v2.15.0-eks-1-33-9).

This chart does not install the NVIDIA Dynamo platform or the inference gateway; dynamoSpec requires Dynamo to be installed separately.

Testing

  • helm dependency build, helm lint, helm template: pass.
  • pytest test/unit_tests/inference (118 passed), pytest test/unit_tests/cli/test_inference.py (51 passed).
  • Server-side dry-run apply of the new CRDs on a cluster with existing IECs: pass.
  • helm upgrade 2.7.0 -> 2.8.3 on a HyperPod cluster: release deployed; CRDs, RBAC, operator image and memory, and the S3/FSx CSI pods rolled out and are Ready.

Before/After UX

Before:

After:

How was this change tested?

Are unit tests added?

Are integration tests added?

Reviewer Guidelines

‼️ Merge Requirements: PRs with failing integration tests cannot be merged without justification.

One of the following must be true:

  • All automated PR checks pass
  • Failed tests include local run results/screenshots proving they work
  • Changes are documentation-only

- Chart 2.7.0 -> 2.8.3, appVersion 3.7 -> 3.8, image tag v3.7 -> v3.8; parent chart dependency bumped to 2.8.3
- Regenerated IEC/JSM CRDs: add IEC spec.dynamoSpec (managed NVIDIA Dynamo), status.selfHealCount, and path-safe pattern and maxLength on invocationEndpoint and loadBalancer.healthCheckPath. Descriptions reworded. Backward compatible.
- Manager memory limit 256Mi -> 512Mi.
- RBAC: grant the operator access to nvidia.com dynamographdeployments.
- Subcharts: aws-mountpoint-s3-csi-driver 1.14.1 -> 1.15.0 (with sidecar image pins), aws-fsx-csi-driver 1.17.0 -> 1.19.0; Chart.lock regenerated.

Signed-off-by: Ophelia Yang <ziyng@amazon.com>
@oyangz
oyangz requested a review from a team as a code owner November 18, 2026 23:03
@oyangz
oyangz deployed to manual-approval November 18, 2026 23:07 — with GitHub Actions Active
@papriwal
papriwal merged commit 871f369 into aws:main Nov 19, 2026
5 of 6 checks passed

This branch was successfully deployed

1 active deployment
manual-approval — 2cdb0d51 Deployed Nov 18, 2026 by oyangz via wait-for-approval #849
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants